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-ABSTRACT- 


R#c-^nt\y  w*  hav^  witn*>aa«>d  th^  advent  *“o£  gen«iat 
purpose  dvita  ba3»  n\ana<j «»in«»nt  ay3t**nis  and  Impoitant  advancea 
'  tf^  computei  networks.  Th**  combination  of  tii»'  two 
techno \ogi»»s  ^to  produce  distributed  data  base  management 
systems  should  be  the  next  significant  step  in  commercial 
systems  development.  A  completely  generalized  aistributed 
data  base  management  system  would  reside  on  a  heterogeneous 
computer  network  with  different  data  base  systems  available 
at  various  processors.  Communication  and  data  transfer 


would  be  possible  between  any  nodes  in  the 
realization  of  this  goal  is  still  several 
furture.  However,  considerable  progress  in 
distributed  data  base  systems  has  been  made  in 
and  industrial  environments. 


network. \  The 
years  in  the 
the  area  of 
both  academic 


This  report  described  the  principal  problem  areas  in 
distributed  data  base  management  system  development. 
Distributed  data  base  systems  share  many  design  problems 
with  both  single  machine  data  base  systems  ana  computing 
networks,  as  well  as  introducing  several  new  dilemmas. 

Recent  research  in  these  problem  areas  is  presented  to 
provide  a  picture  of  the  state  of  the  art  of  distributed 
data  base  development.  In  addition,  the  current  status  of 
the  data  base  industry  with  respect  to  distributed 
processing  is  evaluated  by  reporting  the  current  projects 
and  future  plans  of  selected  (anonymous)  data  base  vendors. 
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Abstract 


Recently  we  have  witnessed  the  advent  of  general  purpose  data  base 
management  systems  and  important  advances  in  computer  netwc  ’'s.  The  com¬ 
bination  of  the  two  technologies  to  produce  distributed  data  base  manage¬ 
ment  systems  should  be  the  next  significant  step  in  commercial  systems 
development.  A  completely  generalized  distributed  data  base  management 
system  would  reside  on  a  heterogeneous  computer  network  with  different 
data  base  systems  available  at  various  processors.  Communication  and  data 
transfer  would  be  possible  between  any  nodes  in  the  network.  The  realiza¬ 
tion  of  this  goal  is  still  several  years  in  the  future.  However,  consider¬ 
able  progress  in  the  area  of  distributed  data  base  systems  has  been  made 
in  both  academic  and  industrial  environments. 

This  report  describes  the  principal  problem  areas  in  distributed 
data  base  management  system  development.  Distributed  data  base  systems 
share  many  design  problems  with  both  single  machine  data  base  systems  and 
computing  networks,  as  well  as  introducing  several  new  dilemmas. 

Recent  research  in  these  problem  areas  is  presented  to  provide  a 
picture  of  the  state  of  the  art  of  distributed  data  base  development. 

In  addition,  the  current  status  of  the  data  base  industry  with  respect  to 
distributed  processing  is  evaluated  by  reporting  the  current  projects  and 
future  plans  of  selected  (anon>'mous)  data  base  vendors. 


INTRODUCTION 


Recently,  we  have  witnessed  the  advent  of  general  purpose  data  base 
management  systems  (DBMS)  and  important  advances  In  computer  networks. 

The  combination  of  the  two  technologies  to  produce  distributed  data 
base  management  systems  should  be  the  next  significant  step  in  commercial 
systems  development.  A  completely  generalized  distributed  data  base 
management  system  would  reside  on  a  heterogeneous  computer  network  with 
different  data  base  systems  available  at  various  processors.  Communi¬ 
cation  and  data  transfer  would  be  possible  between  any  nodes  in  the  net¬ 
work.  The  realization  of  this  goal  is  still  several  years  in  the 
future.  However,  considerable  progress  in  both  academic  and  industrial 
environments  has  been  made  in  the  area  of  distributed  data  base  systems. 

This  report  describes  the  principal  problem  areas  in  distributed 
DBMS  development.  As  indicated  by  Fry  and  Sibley^,  distributed  data 
base  systems  share  many  design  problems  with  both  single  machine  data 
base  systems  and  computing  networks  as  well  as  introducing  several  new 
dilemmas . 

Recent  research  in  these  problem  areas  is  presented  to  provide  a 
picture  of  the  state  of  the  art  of  distributed  data  base  development. 

In  addition,  the  current  status  of  the  data  base  industry  with  respect  to 
distributed  processing  is  evaluated  by  reporting  the  current  projects 
and  future  plans  of  selected  (anon>'mous)  data  base  vendors. 

Distributed  Data  Base  Taxonomy 

Development  of  a  completely  general  distributed  data  base  manage¬ 
ment  system  must  evolve  through  several  less  complex  forms.  This 
evolutionary  process  is  currently  in  progress.  The  beginning  point  of 
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the  development  Is  with  data  base  management  systems  targeted  for  a  single, 
general  purpose  computer.  The  development  of  such  systems  is  among  the 
most  significant  events  in  computer  science.  For  a  detailed  treatment 
of  the  evolution  of  data  base  systems,  see  the  work  of  Fry  and  Sibley.^ 

!«  order  to  properly  classify  distributed  DBMS  research  and 
development,  several  stages  in  the  evolution  of  a  generalized  distributed 
DBMS  are  listed  along  with  a  brief  discussion  of  their  current  status. 

1.  DBMS  for  a  single  general  purpose  machine  -  many  such  systems 
are  commercially  available. 

2.  Data  Base  machines  -  special  purpose  processors  whose  function 
is  data  management.^ 

3.  Back-End  DBMS  -  a  network  of  two  or  more  machines  in  which  one  of 
the  processors  is  dedicated  to  performing  the  data  base  management 
function.  The  dedicated  data  base  processor  is  known  as  the  back-end 
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SMchlne.  The  back-end  machine  may  be  a  general  purpose  computet  or 
contain  specialized  hardware  or  firmware. 

4.  Special  purpose  distributed  DBMS  -  several  special  purpose  data 
base  systems  have  been  implemented  on  computer  networks.  Medical  information 

networks**^  have  been  one  of  the  major  areas  of  emphasis  for  distri- 

•  6 

buted  data  systems.  Airline  reservation  systems  can  also  be  classified 
in  this  area. 

3.  Single  software  DBMS  on  a  homogeneous  network  -  this  is  the 
next  step  to  be  realized  in  distributed  DBMS  development.  Many  hardware 
manufacturers  provide  facilities  for  communication  between  their  own 
SMchlnes.  The  data  base  software  must  be  enhanced  to  allow  tasks  residing 
on  different  processors  to  communicate.  The  problems  of  file  allocation, 
privacy,  and  deadlock  become  quite  complex  at  this  level. 
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6.  Single  software  DBMS  on  a  heterogeneous  network  -  by  allowing 
differing  brands  of  processors  into  the  network,  eompa tab il i ty  problenis 
are  introduced.  Communication  protocols  and  data  conversion  sclu'mes 
are  necessary  for  the  extension  to  heterogeneous  networks. 

7.  Multiple  software  data  base  systems  on  a  heterogeneous  network- 
the  most  general  distributed  DBMS  is  one  which  accomodates  users  with 
different  data  base  software  systems  as  well  as  hardware  obtained  from 
multiple  vendors.  In  addition  to  containing  all  the  problems  of  the 
previously  mentioned  systems,  the  difficult  task  of  data  base  translation 
is  introduced.  Data  base  translation  entails  structural  as  well  as  code 
conversion. 

The  current  status  of  distributed  data  base  systems  reflects  the 
classical  relationship  of  research,  development,  and  production.  Research 
is  ongoing  in  all  of  the  problem  areas  mentioned  in  the  distributed  DBMS 
breakdown.  Progress  in  the  various  areas  is  described  in  the  following 
sections  of  this  report. 

DATA  BASE  MACHINES  AND  BACK-END  PROCESSORS 

The  terms  "data  base  machine"  and  "back-end  processor"  have  recently 
been  added  to  the  computer  lexicon.  Since  they  have  evolved  independently, 
there  is  some  overlap  in  their  accepted  definitions.  A  data  base 
machine  is  a  special  purpose  computer  dedicated  to  data  base  management. 

A  back-end  processor  is  a  computer  that  performs  the  data  management 
function  for  one  or  more  different  computers.  Based  upon  these  definitions, 
it  is  possible  that  a  data  base  machine  be  used  as  a  back-end  processor. 

Let  us  first  observe  the  recent  developments  in  data  base  machines. 

One  of  tile  most  common  operations  performed  in  a  DBMS  is  the  location  of 
data  given  some  key.  A  natural  method  for  constructing  an  efficient 
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DBMS  priHi'ss  is  to  optimi/o  tlio  data  look-up  opo  r.i  t  ion  .  Con.'u-fiucii  t  1  >  , 

assoc  i  a  l  i  VO  proci's,-.oi  s  h.ivo  Boon  pi  i'posc-il  for  u;;aj’t'  .1;;  dat.i  base 

..  7-10 

machines 

g 

DeFiore  and  Bera  show  that  the  parallel  search  capabilities 
of  an  associative  DBMS  allow  it  to  outperform  an  inverted  list  structure 
in  an  inquir>’  environment.  They  liave  developed  a  data  management 
system  using  associative  memory  at  Rome  Air  Development  Center. 

This  system  uses  the  associative  processor  as  a  small,  fast  memory  buffer. 
The  data  base  is  stored  on  conventional  secondary  storage  devices  and 
paged  into  the  associative  memory.  The  associative  memory  allows  searches 

in  the  order  of  microseconds  but  the  page  transfer  is  in  the  order  of 
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milliseconds.  The  CASSM  project  at  the  University  of  Florida  developed 
the  concept  of  a  context-addressable  disc  system  capable  of  performing 
data  manipulations  in  secondary  memory  independent  of  the  CPU.  By 
storing  the  data  base  on  the  associative  machine,  the  excessive  loading 
delay  is  eliminated.  The  approach  taken  in  the  CASSM  project  has 
been  followed  at  the  University  of  Toronto  by  Ozkarahan,  Schuster, 
and  Smith^*^  in  the  design  of  an  associative  processor  -  RAP  whose 
instruction  set  is  a  high-level  relational  data  base  language.  By 
processing  data  operations  at  the  machine  level,  RAP  lias  tlie  potential 
of  overcoming  the  execution  time  problems  that  have  hampered  relational 
data  base  systems.  RAP  is  designed  to  operate  upon  data  base  of  up  to 
lOOM  bits.  This  capacity  can  be  extended  by  conventional  mass  storage 
devices. 

The  concept  of  a  processor  with  data  base  primitives  is  also 
under  investigation  by  Anderson^^  who  has  proposed  placing  the  data 
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base  functions  in  firmware. 


Tlie  microprogramable  data  base  processor  is 


proposed  as  a  back-cnd  machine  by  Anderson.  This  processor  could 
either  be  directly  connected  to  a  single  general  purpose  processor  or 

ect  as  a  specialized  data  base  processing  node  In  a  network. 

12 

The  Datacoiaputer  has  been  developed  by  Computer  Corporation  of 
America  as  a  special  purpose  data  base  processor  -  for  use  in  hetero¬ 
geneous  networks.  The  Datacomputer  in  its  current  version  is  a  PDP-10 
that  provides  data  base  service  In  the  Arpanet.  The  data  base  management 
system  which  uses  the  Inverted  file  structure  concept  Is  strictly  a 
softvrare  implementation.  All  requests  for  data  base  operations  are 
transmitted  to  the  Datacomputer  in  Datalanguage  which  Is  a  high-level 
data  base  language.  Since  the  Datacomputer  Interfaces  with  a  variety 
of  machine  types,  it  must  perform  translations  between  various  physical 
data  representations  and  logical  data  structures.  Because  of  its 
ability  to  communicate  with  heterogeneous  machines,  the  Datacomputer 
as  implemented  in  the  Arpanet  is  the  closest  existing  approximation  to  a 
completely  distributed  data  base  system.  The  necessary  extensions  are 
the  geographic  distribution  of  data  which  could  be  accomplished  by 
placing  Datacoraputers  ar  several  points  in  the  network  and  the  incorpora¬ 
tion  of  different  software  dai:a  base  systems  into  the  network.  The 
communication  between  different  data  base  systems  remains  a  major  hurdle 

to  a  generalized,  distributed  DBMS. 

13 

The  INFOPLEX  sys^tem  which  is  presently  under  design  is  intended  to 
be  a  highly  parallel  Information  management  system.  INFOPIZX  is  similar 
in  terms  of  organization  to  CASSM  and  RAP  in  that  the  data  base  management 
function  is  performed  by  a  complex  of  microprocessors.  Eacft'  high-level 
data  base  request  is  functionally  decomposed  and  executed  ia  parallel  by  the 
microprocessor  complex.  The  concept  of  decomposition  of  Aaitj  base 
requests  could  be  applied  at  a  higher  level  to  a  network  off  minicomputer 
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dat.i  h.isi'  iTiaohiiu';;  which  .''.hare  itie  managenont  of  a  data  base. 

Hie  single  host,  single  back-end  approach  has  been  implemented  as 

3 

a  prototype  by  Cvinaday,  et  al  at  Bell  Telephone  Laboratories.  Tlie 
XDMS  consisted  of  a  I'N'IVAC  1108  host  which  executed  the  application 
programs  and  .i  MKTA-'h  back-end  which  performed  the  data  base  functions. 

The  soitware  system  used  wasDMS-1100  which  is  a  derivative  of  the 
COLASi L  specit ications .  XDMS  was  the  first  working  back-end 

system  and  has  provided  impetus  for  considerable  future  work  in  this  area. 


Benefits  of  Ba ck-End  DBMS 

A  back-end  D3.MS  can  serve  as  the  nucleus  of  a  distributed  data 
base  system.  Based  upon  work  presently  under  way  in  the  data  base 
industry,  the  author  can  project  the  emergence  of  a  back-end  computer 
as  a  significant  product  in  the  near  future. 

The  first  versions  of  the  back-end  computers  will  be  general 
purpose  minicomputers  whicli  contain  software  data  base  systems. 

The  back-end  machines  will,  interface  with  IBM  360/370's  (or  similar 
mainframes)  via  conventional  linkages.  Later  versions  will  include 
special  purpose  data  base  machines  and  more  general  and  higher  speed 
machine  interconnections.  These  projections  are  made  based  upon  an 
analysis  of  the  recent  research  advances  outlined  in  the  previous 
section  and  discussions  with  individuals  in  the  data  base  industries. 

An  evaluation  of  the  current  state  of  the  industry  appears  in  a 
later  section  of  this  paper. 

The  f  cas  ib  i  1  i  ty  of  a  back-end  DBMS  in  a  data  proce^:sing  environnent 
has  been  the  subject  of  several  reports. These  studies  indicate 
that  a  back-end  DBMS  can  provide  benefits  in  a  wide  range  of  areas. 

The  effects  of  a  back-end  DBMS  are  briefly  considered  here. 


all  of  the  machine's  resources. 


Therefore  additional  cornputiiip,  power 


becomes  available  at  a  relatively  low  price. 

e.  Modularity  -  The  basic  back-end  configuration  forms  a  well- 
structured  compact  unit.  New  maclnnos  can  be  added  easily  to  this 
conf igura t ion  either  in  a  multi-processor  back-end  arrangement  or 
as  a  stand  alone  ctimpurer. 

0RG.-V\'1Z.4TI0N  OF  DISTRIBUTED  DATA  BASE  SYSTEMS 

There  have  been  several  alternative  organizations  proposed  for 

distributed  data  base  systems.  The  function  of  the  system,  the 

geographic  distribution  of  the  data^and  the  philosophy  of  the  designers 

all  influence  the  organization  of  the  distributed  system.  In  all 

cases,  the  distributed  DBMS  resides  on  a  computer  network.  In  the 

next  section  the  characteristics  of  the  interface  between  the  network 

and  data  base  software  are  discussed. 

Several  approaches  have  been  used  in  the  description  of  dis- 
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tributed  data  base  organization.  Aschim  classifies  data  bases 
according  to  the  geographical  distribution  of  data  bases  and  direc¬ 
tories.  Data  base  and  directories  may  either  be  centralized  or 
distributed  under  this  scheme.  Figures  1  and  2  illustrate  the 
situations  of  distributed  data  bases  with  a  centralized  directory  and 
distributed  directory  respectively.  Aschim  also  describes  the  benefits 
and  problems  of  a  single  and  multiple  software  systems  controlling  data 

base  operations. 
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Booth  classifies  distributed  data  bases  by  the  amount  of 
redundancy  in  the  data  base.  She  describes  partitioned  data  bases 
as  logical  data  base  spread  across  several  computers  and  replicated 
data  bases  in  which  portions  of  the  data  base  are  replicated  at 


dlffuront  nodos  in  the  network.  D.it.i  bases  nay  be  partitioned 

based  upon  accessibility;  that  is,  the  locating  files  at  the  machine 

at  which  they  are  most  likely  to  receive  the  heaviest  usage.  This 

technique  reduces  the  amount  of  intermachine  communication  which  can 

20 

become  the  limiting  factor  in  distributed  data  base  performance. 

22 

Booth  also  describes  a  vertical  partitioning  technique,  sec  Figure  3, 
In  which  a  large  central  data  base  is  supplemented  by  several  remote 
data  bases. 

23 

In  an  earlier  paper,  Booth  provides  an  analysis  of  the  tradeoffs 
between  redundancy  and  division  of  data  in  a  distributed  network.  The 
benefits  of  redundancy  in  a  distributed  environment  are  increased 
access  to  the  multiple  copies  of  the  data,  readily  available  backup,  and 
decreased  communication  time  to  access  the  data  since  a  copy  can  be 
located  close  to  the  point  at  which  it  is  used.  The  primary  problems 
resulting  from  redundancy  are  the  cost  and  complexity  of  updating  a 
redundant  data  file  and  the  requirement  of  additional  storage  services. 
When  a  large  active  file  is  divided  among  several  back-end  processors 
in  a  distributed  system,  accessibility  of  the  data  can  be  increased. 
However,  there  is  some  control  and  communications  overhead  in  the 
distributed  situation,  as  opposed  to  the  case  of  a  single  data  file 
accessed  by  one  computer.  The  development  of  efficient  network 
software  can  minimize  this  overhead. 

C0>C'njNlCATI0N’  IN  A  DISTRIBUTED  DATA  BASE  NETWORK 

A  distributed  data  base  management  system  must  be  built  upon  a 
computer  networking  facility.  Since  communication  time  is  a  critical 
factor  in  distributed  data  base  performance,  an  efficient  network 
communciation  moclianism  is  an  essential  requirement  for  a  distributed 
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dat;i  ba;;o  systotn.  Ttio  complexity  of  the  network  control  software  Is 
related  to  the  homop.enet  it  y  of  the  machines  in  the  network.  If  the  soft¬ 
ware  data  base  systems  on  conversing  machines  are  of  different  types, 
then  a  sophisticated,  translation  mechanism  must  be  developed. 

Network  control  software  for  distributed  data  bases  has  been 

21 

functionally  specified  by  several  researchers.  Aschim  describes  a 
message  switching  environment  for  the  communication  of  data  base  requests 
between  a  host  and  back-end  machine.  He  describes  the  information 

that  the  host  and  back-end  communication  tasks  must  have  available. 

21 

According  to  Aschim,  the  host  communication  task  must  have 
knowledge  of  the  following  items. 

1.  The  identification  of  the  back-end  task  that  will  access 
the  requested  data; 

2.  The  data  base  name  of  the  requested  data; 

3.  Translation  requirements; 

A.  The  interprocess  protocol; 

5.  The  mechanism  for  interpreting  the  response. 

Similarly,  the  back-end  communication  task  must  have  the  follov/ing 
information : 

1.  Type  of  message  received; 

2.  Translation  requirements; 

3.  The  mechanism  to  satisfy  the  data  base  request; 

4.  Identification  of  sending  process; 

5.  Conditions  for  sending  a  response; 

6.  Interprocess  protocol. 

24 

Peebles  proposes  a  separation  of  the  network  communication 
and  data  base  control  functions.  He  specified  a  netw’ork  control 
language  for  generalized  intermachine  communication.  A  translation 
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mcchnni .‘;in  is  contained  within  the  network  control  language.  A  distri¬ 
buted  data  base  management  system  can  be  developed  on  top  of  the 
network  communication  system. 

The  interface  between  a  data  base  managraent  system  and  a  network 

25 

communication  systerr  is  explained  by  Maryanski,  et  al .  Tlie  communi¬ 
cation  system  proposed  in  that  paper  provides  standard  methods  for 
inter-task  communication  and  a  protocol  for  the  transmission  of  infor¬ 
mation  among  processors.  In  this  system  the  translation  mechanism  is 
considered  a  part  of  the  data  base,  not  the  network,  software. 

Additional  details  of  the  application  of  the  network  communication 
system  to  a  distributed  data  base  environment  are  given  by  Wallentine 
and  Maryanski. 

12 

The  Datacoraputer  relies  upon  the  standard  Arpanet  communication 
facilities  to  exchange  information  with  its  host  processors.  All 
communication  occurs  in  Datalanguage  which  can  be  viewed  in  this 
context  as  a  standardized  message  facility.  The  Datacomputer  per¬ 
forms  all  translations  internally.  However,  the  form  of  stored  data 
is  determined  by  the  host  machine. 

FILE  ALLOCATION  IN  DISTRIBUTED  DBMS 

One  of  the  key  decisions  to  be  made  by  a  data  base  administrator 
is  the  allocation  of  data  files  among  physical  devices.  The  ultimate 
goal  of  an  allocation  policy  is  to  equally  distribute  the  utilization 
of  the  devices.  A  file  allocation  policy  requires  information,  actual 
or  hypothesized,  concerning  file  utilization.  In  many  environments, 
data  base  behavior  is  dynamic.  Therefore,  utilization  patterns  must 
be  constantly  monitored  in  order  to  insure  an  acceptable  file  distribution. 


Naturally,  there  is  a  cost  associated  with  monitoring  file  utilization 
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and  reallocating  files.  A  balance  between  the  costs  of  a  non-optinal 

file  organization  and  the  cost  of  reallocation  must  be  achieved. 

When  a  data  base  is  distributed  over  several  machines,  the 

complexity  of  the  file  allocation  problem  increases.  In  a  centralized 

DBMS,  poor  file  allocation  results  in  heavy  traffic  on  certain  channels 

and  excessive  waiting  for  the  channels.  In  a  distributed  environment, 

communication  cost  of  obtaining  data  from  a  file  resident  at  another 

network  node  becomes  an  important  factor.  Data  must  be  allocated 

first  among  back-end  processors  and  then  among  the  devices  attached 

27 

to  the  back-end  processors.  Morgan  and  Levin  have  proposed  three 
parameters  for  describing  file  allocation  algorithms  for  distributed 
data  base  management  systems.  The  parameters  are: 

1.  Level  of  data  sharing; 

2.  Behavior  of  access  patterns; 

3.  Type  of  information  available  on  the  behavior  of  acess 
patterns. 

The  level  of  sharing  indicates  whether  the  DDBMS  is  partitioned, 
replicated,  or  some  combinationof  the  two  organization  schemes.  The 
access  pattern  of  the  system  may  span  the  spectrum  from  inquiry  only 
to  total  update.  The  important  factor  for  file  allocation  is  if  the 
access  pattern  may  vary  significantly.  The  final  parameter  is  whether 
the  information  on  the  behavior  of  the  access  patterns  is 
deterministic  or  probabilistic. 

The  standard  approach  in  file  allocation  problems  is  to  develop 

a  generalized  cost  equation  and  then  seek  a  file  assignment  which 

minimizes  that  equation.  At  the  highest  level,  the  cost  function 
27 

can  be  given  as 


in 


* 


MMriiiiiiiiiiiAiituaiM 


13 


C(A|^)  =  Q(A^)  +  (1) 

where 

Aj^  is  the  assignment; 

Q(Aj^)  is  the  query  cost  of  the  assignment; 

U(A^)  is  the  update  cost;  and 
s(V  is  the  storage  cost. 

As  of  the  present  time,  the  results  obtained  for  file  allocation 

in  distributed  data  base  networks  are  for  cases  of  static,  deterministic 

access  patterns.  However,  Morgan  and  his  associates  are  studying  the 

properties  of  networks  in  which  access  patterns  vary  dynamically  or 

27 

are  described  by  probability  distributions. 

28 

Levin  has  shown  chat  the  multiple  file  allocation  problem  for 

the  static,  deterministic  case  can  be  solved  by  determining  the 

optimal  allocation  for  the  individual  files.  Levin's  cost  function  is 

29 

a  refinement  of  eq.  (1).  The  model  developed  by  Chu  represents 

file  allocation  cost  as  the  sum  of  storage  and  transmission  times. 

The  overall  structure  of  Levin's  and  Chu's  model  are  quite  close,  both 

involving  linear  programming  techniques  to  effect  a  solution. 

30 

Casey  studies  the  file  allocation  problem  for  tree  networks 
which  are  a  restricted  type  of  network  topology.  In  a  tree  network, 
there  arc  no  loops  formed  by  internode  paths.  Casey  selected  tree 
networks  because  of  both  their  simplicity  and  practicality.  Trees 
have  no  routing  problems  and  are  the  optimal  organization  in  a  distri¬ 
buted  data  base  with  a  multiple  host,  single  back-end  structure.  The 
most  significant  feature  of  tree  networks  with  respect  to  file 

allocation  is  that  the  cost  equations  are  less  complex  than  those 
29  28 

developed  by  Chu  and  Levin  for  nxjre  general  network  organizations. 


A  different  cominitat lonal  approach  to  computing  tlic  optimal  file 

31 


allocation  is  presented  by  Casey  in  another  work.  He  uses  a  linear  cost 
model  for  the  allocation  of  network  resources  that  is  similar  to  those  used  to 
determine  the  most  economical  location  for  plants  and  warehouses.  A 


search  procedure  which  is  shown  to  produce  an  optimal  allocation  is 
31 


developed.  Casey  also  suggests  some  heuristics  intended  to  improve 
performance  of  the  algorithm.  This  work,  in  effect,  applies  goal- 
oriented  searching  techniques  commonly  used  in  artificial  intelligence 


work  to  the  file  allocation  problem. 
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Chu  has  also  studied  the  relationship  between  access  type  and 

32 


distributed  data  base  organization.  Chu  develops  cost  equations  for 
partitioned,  partially  replicated,  and  fully  replicated  data  bases 
(i.e.,  a  copy  of  a  file  at  each  node  which  assesses  the  file).  A 
partially  replicated  configuration  contains  one  copy  of  every  data 
file  for  each  cluster  in  the  network.  A  group  of  processors  joined 
together  via  very  high  speed  links  (memory-to-memory  connections) 


forms  a  cluster.  Using  a  cost  equation  based  upon  communication, 

32 


storage,  and  translation  costs,  Chu  reaches  the  intuitively  appealing 
result  that  in  query  mode  a  replicated  data  base  provides  superior 
performance, while  under  heavy  update  a  partitioned  data  base  organiza¬ 
tion  is  more  efficient.  Under  the  assumption  that  transmission  cost 
is  higher  than  storage  costs,  Chu  indicates  a  breakeven  point  of  10% 
update  between  replicated  and  partitioned  and  50%  update  between  fully 
and  partially  replicated. 

33 

The  special  case  of  a  100%  query  environment  is  treated  by  Ghosh 
who  addresses  the  problem  of  distributing  a  data  base  in  order  to 
provide  for  completely  parallel  searching.  Ghosh  provides  algorithms 
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that  specify  a  data  base  distribution  that  allows  parallel  searching 
from  a  set  of  queries  with  a  given  form  and  a  specific  number  of  pro¬ 
cessor  nodes.  He  considers  both  replicated  and  partitioned  data  base 
organization.  Again  the  tradeoff  of  redundancy  in  the  data  base  is 
considered;  lower  search  time  versus  increased  storage  costs. 

Thus  far,  the  discussion  on  file  organization  has  concentrated 

upon  the  distribution  of  data  among  processor  nodes  of  a  distributed 

34 

data  base  network.  Salasin  describes  a  method  for  distributing  a 
data  base  over  the  storage  hierarchy  of  a  single  processor.  The  storage 
devices  of  the  processor  are  ordered  in  terms  of  access  speed.  The 
difference  between  the  conventional  storage  organization  and  Salasin's 
hierarchical  approach  is  illustrated  in  Figure  4.  The  most  significant 
performance  feature  of  this  proposed  storage  arrangement  is  the  bufferring 
of  data.  If  data  is  found  at  level  K,  it  is  also  present  at  all 
higher  levels.  Salasin  constructs  probabilistic  models  which 
indicate  that  bufferring  provides  performance  benefits  for  sequential, 
random,  and  linked  list  file  organizations. 

File  organization  has  been  studied  more  thoroughly  than  other 
subjects  related  to  distributed  data  bases.  Many  linear  programming 
methods  have  been  proposed  for  the  determination  of  optimal  file 
placement.  The  practicality  of  these  methods  for  use  in  data 
processing  environments  is  a  matter  of  conjecture.  The  main  problems 
are  that  the  algorithms  require  precise  usage  statistics  and  do  not 
consider  constraints  imposed  by  security  or  company  policy. 

DEADLOCKS 

A  good  file  allocation  scheme  results  in  efficient  utilization  of 
a  distributed  data  base  management  system.  However,  if  a  distributed 
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DBMS  dcsip.ncr  ignores  file  allocation,  it  is  likely  that  the  system  v;ill 
still  operate  (perhaps  in  a  very  inefficient  manner).  This  situation 
does  not  hold  for  the  deadlock  problem.  If  the  system  designer  does 
not  consider  the  possibility  of  deadlocks,  severe  problems  may  arise. 

Deadlock  in  a  DBMS  is  an  unfortunate  side  effect  of  the  need  for 
a  portion  of  the  data  base  to  be  shared  by  several  data  base  tasks ^ 
at  least  one  of  which  is  updating  the  shared  information.  For  example, 
if  a  record  is  to  be  updated  by  a  task,  it  is  necessary  that  no  other 
task  be  allowed  to  access  the  record  during  the  update  procedure.  Failure 
to  provide  a  blocking  mechanism  can  result  in  incorrect  information 
appearing  in  the  data  base.  If  there  are  portions  of  the  data  base 
that  may  be  accessed  simultaneously  by  several  tasks,  then  a  deadlock 
condition  may  occur.  Deadlock  occurs  when  two  or  more  tasks  have 
blocked  each  other  from  execution  by  locking  shared  portions  of  the 
data  base.  Figure  5  illustrates  deadlock  of  two  data  base  tasks. 

The  underlying  cause  of  deadlock  in  data  base  systems  is  the 
organization  of  conventioiial  secondary  storage  media.  In  order  to 
optimize  the  utilization  of  secondary  storage^ several  requests  must 
be  processed  simultaneously.  This  organization  tends  to  reduce  disk 
head  movement  and  latency  which  is  often  the  limiting  factor  in  per¬ 
formance  of  a  data  base  system.  The  deadlock  problem  can  be  avoided 
in  systems  which  do  not  use  convential  secondary  storage.  Associative 
machines  ^  batch  all  data  base  requests  and  provide  the  task  issuing 
the  request  exclusive  control  of  the  data  base,  thus  avoiding  deadlock. 

The  deadlock  problem  has  been  studied  at  great  length  by  researchers 
In  oper.itJiij'  system--. .  The  general  principles  for  llu-  detection  or 
prevention  o)  deadlock  that  have  been  developed  by  tliese  researcher^■. 


17 


arc  also  applicable  to  data  ba.so  management.  However,  the  DBMS 

deadlock  problem  is  compounded  by  the  need  Co  insure  tliat  uniformly  correct 

data  is  maintained  throughout  the  system. 

For  example,  if  in  the  situation  depicted  in  Figure  5,  the  dead¬ 
lock  is  resolved  by  returning  Task  A  to  its  starting  point  and  releasing 
its  resources  (this  procedure,  is  called  "rollback"),  then  Record  1 
must  be  restored  to  its  condition  prior  to  being  modified  by  Task  A. 

If  the  locking  procedure  used  permits  retrieval  while  preventing 
updates  by  other  tasks,  then  it  is  possible  that  some  Task  C  may  have 
retrieved  and  operated  upon  Record  1  in  its  altered  state  (after  step 
a^) .  In  this  situation  Task  C  would  also  have  to  be  rolled  back. 

Rollback  of  Task  C  may  result  in  the  necessity  of  rolling  back  still 
other  tasks  in  the  system,  thus  causing  a  substantial  performance 
degradation. 

Deadlock  in  data  base  management  systems  has  been  investigated 
35-41 

by  several  researches.  However,  relatively  little  work  has 

concentrated  on  deadlock  in  distributed  data  base  management  systems. 

In  a  distributed  DBMS  the  problem  is  complicated  by  the  fact  that  the 
interacting  tasks  may  reside  upon  different  machines.  Therefore,  the 
communication  overhead  in  the  rolling  back  of  tasks  can  become  very 
substantial.  Consequently,  in  a  distributed  DBMS,  a  deadlock  prevention 
scheme  may  provide  better  overall  system  performance  than  a  deadlock 
detection  approach. 

Preventing  deadlocks  in  a  distributed  DBMS  is  the  subject  of  a 

42 

report  by  Chu  and  Ohlmacher.  They  propose  two  approaches  to  deadlock 
prevention.  The  first  method  requires  a  data  base  task  to  indicate 
its  resource  (file)  requirements  before  initiation.  A  task  is  started 
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only  if  all  requested  resources  can  be  assigned  to  the  task.  This 
approach  Is  very  straightforward.  However,  a  task  may  not  access  all 
files  In  a  given  execution.  Thus,  the  initiation  of  a  task  may  be 
needlessly  delayed. 

The  second  technique  for  deadlock  prevention  proposed  by  Chu 
and  Ohlmacher  Is  based  upon  the  notion  of  Cask  sets.  A  task  set  is  a 

collection  of  tasks  with  access  to  common  files.  Whenever  a  task  has 

the  need  to  access  a  file,  the  system  determines  If  all  files  that  may 
be  accessed  by  the  requesting  task  and  other  members  of  its  task  set 
are  available.  If  all  such  files  are  free,  the  task  is  permitted  to 
proceed.  Otherwise,  Che  task  must  wait  until  Its  files  are  available. 

The  task  sets  change  as  tasks  are  Initiated  and  terminated.  Chu 

and  Ohlmacher  present  an  algorithm  for  assigning  the  control  of  a 

particular  cask  set  to  a  processor  node  in  the  network.  All  requests 
for  files  by  tasks  in  the  set  must  be  directed  Co  the  controlling 
processor. 

An  analysis  of  the  two  proposed  deadlock  prevention  algorithms 
for  distributed  data  base  systems,  indicates  that  the  dynamic  nature 
of  the  second  technique  has  both  benefits  and  drawbacks.  It  has 
the  advantage  of  allowing  tasks  to  proceed  until  an  actual  file 
request  occurs.  However,  the  maintenance  of  the  task  sets  may  require 
considerable  .communication  overhead  In  a  network  environment. 

An  Important  factor  for  any  proposed  deadlock  handling  algorithm 
for  distributed  data  bases  would  be  operational  efficiency.  Due  to 
the  complexity  of  distributed  data  base  systems,  it  is  difficult  to 
determine  the  efficiency  of  such  algorithms  analytically.  Tliercfore, 
the  practicality  of  the  treatment  of  a  deadlock  in  a  distributed  DBMS 
cannot  be  determined  until  more  distributed  data  bases  are  implemented. 


DATA  TRANSLATION 


One  of  the  problems  that  faces  the  designer  of  a  distributed  DBMS 
composed  of  multiple  software  systems  on  a  heterogeneous  network  Is 
data  Incompatibility.  The  problem  of  disparate  Internal  data  represen¬ 
tations  Is  complicated  by  different  logical  structures  In  the  data  base 
system.  Since  these  differences  are  a  fact  of  life  in  data  processing, 
a  method  of  data  base  translation  is  necessary  for  the  most  general 
^case  of  distributed  network.  For  a  network  with  K  different  data  base 
systems,  a  "brute  force"  translation  approach  Is  to  construct  a  unique 
translator  for  each  pair  of  data  base  systems.  The  problem  of  translating 
between  two  given  data  base  systems  on  specified  computers  Is  a  well 
defined  but  non- trivial  task.  However,  this  approach  would  require 
each  DBMS  node  to  have  2  (K-1)  translators  available  to  map  to  and  from 
every  other  DBMS  node  in  the  network. 

Several  alternatives  to  the  "brute  force"  or  "K  to  K"  data 

translation  approach  have  been  considered.  A  major  effort  in  this 

43-45 

area  Is  the  University  of  Michigan  Data  Translation  Project. 

Figure  6  Illustrates  the  translation  methodology  developed  by  Fry 

and  his  associates  at  Michigan.  All  data  bases  are  described  using 

a  universal  Stored  Data  Definition  Language  (SDDL) .  The  translations 

are  driven  by  tables  produced  by  compilers  for  the  SDDL  and  the 

Translation  Definition  Language  (TDL) .  The  TDL  is  employed  to  express 

the  relationship  between  Che  source  and  target  data  bases.  This 

translation  methodology  requires  only  one  translation  program  at  each 

DBMS  node.  However  the  translator  must  be  supplemented  with  an  SDDL 

45 

Table  and  (K-1)  TDL  Tables.  Birss  and  Fry  discuss  the  feasibility 
of  the  Data  Translation  Project  Methodology  based  upon  their  prototyping 
experiences . 
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Schneider  proposes  a  Data  Spec i f ication  and  Conversion  Language 
(DSCL)  for  data  base  networks.  n»e  DSCL  is  a  high  level  language  for 
data  translation.  Schneider  suggests  that  one  machine  in  the  distri¬ 
buted  DBMS  serve  as  the  network  translator  as  shown  in  Figure  7.  All 

coranunication  with  the  translation  machine  uses  DSCL.  The  translation 

2 

machine  effectively  contains  K  different  translation  programs.  The 
main  advantage  of  this  technique  is  that  the  only  additional  software 
required  on  the  DBMS  nodes  are  utility  routines  to  map  to  and  from 
DSCL. 

12 

The  Datacomputer  which  is  a  back-end  machine  in  the  ARPA  network 
communicates  with  its  host  machines  only  in  Datalanguage .  Each  host 
processor  accessing  information  controlled  by  the  Datacomputer  must 
perform  translations  to  and  trom  the  Datalanguage  format.  The 
Datacomputer  is  a  special  case  of  the  general  data  translation  problem. 
However,  the  fact  that  it  is  a  viable  node  in  the  ARPA  network  illustrates 
the  feasibility  of  that  approach. 

The  approaches  to  data  translation  discussed  thus  far  are  totally 
automatic.  Su  and  Lam  have  designed  an  interactive  translation 
system  in  which  the  user  participates  in  composing  the  logical  structure 
of  the  target  data  base.  The  system  requires  a  separate  translator 
for  each  distinct  target  machine.  This  approach  provides  the  user  with 
considerable  flexibility  in  restructuring  the  target  data  base. 

However,  it  requires  user  intervention  for  any  intermachine  data  base 
communication.  Therefore,  the  interactive  approach  is  best  suited  for 
infrequent  large  scale  data  transfers.  A  prototype  has  been  con¬ 


structed  by  Su  and  Lam. 
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Distributed  data  base  systems  with  information  and  control  spread 
over  a  number  of  computers  pose  many  interesting  security  problems. 
Since  many  data  bases  contain  classified  or  private  information, 
thought  must  be  given  to  the  security  of  data  before  determining 
if  any  benefits  are  to  be  gained  by  multi-computer  access.  The 
principal  security  question  with  regard  to  distributed  data  bases  is 
whether  a  distributed  DBMS  is  inherently  more  or  less  secure  than  a 
single  machine  system.  An  analysis  of  distributed  data  base  systems 
indicates  that  they  provide  both  advantages  and  drawbacks  with  respect 
to  security. 

The  security  benefits  arise  in  configurations  which  contain 
dedicated  back-end  machines.  Lownethal^^  indicates  that  a  computer 
solely  dedicated  to  the  processing  of  data  base  operations  is  able  to 
screen  every  data  basi-  request  from  the  host  machines.  One  important 
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security  aspect  of  the  dedicated  back-end  machine  is  that  no  appli¬ 
cation  programs  execute  on  it.  This  eliminates  the  threat  of  a 
malevolent  program  monitoring  data  base  activity. 

The  most  outstanding  security  liability  of  a  distributed  data 
base  system  is  the  use  of  public  cocaiunication  lines  in  geographically 
dispersed  networks.  An  Intruder  using  current  technology  can  easily 
■unitor  the  transmissions  between  remote  installations.  A  designer  of 
a  secure  geographically  distributed  DBMS  must  rely  upon  encryption 
techniques  to  preserve  security.  ^ 

STATE  OF  THE  INDUSTRY 

Distributed  data  bases  are  on  the  verge  of  becoming  a  commercial 
reality.  Back-end  data  base  systems  are  presently  in  the  development 
stage  at  the  installations  of  several  hardware  and  software  vendors. 

It  is  difficult  to  report  Industrial  progress  without  either  pro¬ 
viding  free  publicity  or  revealing  proprietary  information.  However, 
it  is  Important  that  the  significance  of  distributed  data  base  systems 
be  emphasized  by  describing  the  work  underway  in  the  commercial  sector. 
Therefore,  this  section  contains  brief  descriptions  of  projects 
currently  underway  at  several  vendors'  installations  with  no  specific 
references  to  either  the  vendor  or  its  product  line. 

The  back-end  machine  has  been  a  focal  point  of  the  industry's 
thrust  into  distributed  systems.  Virtually  all  vendors  have  followed 
Canaday's^  initial  prototype  by  using  a  minicomputer  as  the  back-end 
machine.  One  software  vendor  Is  presently  developing  a  back-end  DBMS 
targeted  for  a  specific  large  mainframe  host  and  minicomputer  back-end 
Their  DBMS  software  presently  operates  on  both  machines  in  a  stand 
■lone  manner.  The  major  developmental  effort  on  the  project  is  the 
implementation  of  a  communication  system  between  the  two  machines. 
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When  compleCe,  this  particular  back-cnd  DBMS  will  be  suitable  for 
use  with  both  locally  and  remotely  connected  machines. 

Another  software  vendor  Is  taking  the  data  base  machine  approach 
to  distributed  data  base  systems.  This  company  Is  developing  a  back¬ 
end  DBMS  version  of  their  software  on  a  minicomputer  and  a  generalized 
communication  system  written  in  an  easily  portable  systems  Implementation 

language.  They  intend  to  market  the  minicomputer  as  a  "blackbox" 

» 

i4ilch  can  be  attached  by  means  of  their  coannunications  software  to 
several  large  mainframe  computers.. 

Hardware  vendors  are  also  actively  pursuing  the  idea  of  dis¬ 
tributed  data  bases.  One  manufacturer  is  studying  the  feasibility 
of  constructing  a  back-end  machine  from  a  cluster  of  microcomputers  in 
a  manner  similar  to  Madnick's  INFOPLEX.^^  In  the  system  being  studied, 
a  data  base  re<iuest  would  be  decomposed  into  primitives  and  processed 
In  parallel  by  the  mlcrocciiputers.  This  approach  is  very  well  suited 
for  a  relational 

Another  hardware  manufacturer  is  investigating  the  concept  of  a 
microprogrammable  back-end  machine.  This  back-end  processor  would 
be  a  minicomputer  that  could  be  connected  via  a  high  speed  interface 
to  the  vendor's  large  mainframe  CPU's.  Through  the  use  of  special 
purpose  data  base  Instructions  in  firmware,  a  high  performance 
back-end  machine  can  be  developed.  The  vendor  is  also  considering 
configurations  of  multiple  back-end  processors. 

From  this  small  sample  of  the  activity  in  the  data  base  Industry, 

It  can  be  seen  that  distributed  data  base  systems,  in  particular 
back-end  machines,  will  soon  appear  in  the  marketplace.  This  is  a 
result  of  an  intersection  of  advances  in  hardware  and  software 
technology  with  a  need  for  greater  access  to  and  sharing  of  information. 
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CONCLUSION 

Distributed  data  base  management  systems  are  the  focus  of  a  large 
amount  of  research  and  development  activity  in  both  the  academic  and 
industrial  environnohts .  Distributed  data  base  systems  provide  a 
means  of  extending  the  capacities  of  computing  systems  to  allow  a 
wide  range  of  information  to  be  accessed  by  many  people.  As  is 
typical  of  the  current  computer  environment,  the  hardware  technology 
of  distributed  data  base  has  advanced  further  than  the  software. 

Many  obstacles  remain  before  a  truly  general  distributed  DBMS 
will  appear.  However,  back-end  data  base  systems,  data  base  machines, 
and  distributed  information  systems  are  available  now  (or  will  be 
available  within  the  next  year).  In  the  next  several  years,  advances 
in  distributed  data  base  management  systems  should  be  among  the  most 
significant  in  the  computer  field. 
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